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The MAILING DATE of this communication appears on the cover sheet with the correspondence address -- 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE MONITH(S) FROM 

THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )□ Responsive to communication(s) filed on 12 October 2004 . 
2a)D This action is FINAL. 2b)M This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) KI Claim(s) 1 and 3-25 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

. 5)Q Claim(s) is/are allowed. 

6) |EI Claim(s) 1 and 3-25 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) KI The drawing(s) filed on 01/25/01 is/are: a)[>3 accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 0 Certified copies of the priority documents have been received. 

2.n Certified copies of the priority documents have been received in Application No. . 

3-D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 



1. 



Applicant's after final response, 10/12/04 has been entered and made of 



record. 



2. 



Claim 2 has been previously been canceled by the applicant. Currently, 



claims 1 and 3-25 are pending. 



3. 



Applicant's arguments, see pages 7-11, filed on 10/12/04, 



with respect to the rejection(s)of claim(s) 1, 3-8, 10, 14, 16, 17, and 19-21 under 
35 USC 102(b) and claims 9, 15, 18, and 22-25 under 35 USC 103(a) have been 
fully considered and are persuasive. Therefore, the rejection has been 
withdrawn. However, upon further consideration, a new ground(s) of rejection is 
made in view of Courtney (U.S. patent 5,969,755), Gran et al. (U.S. patent 
5,416,711), Koike (U.S. patent 6,445,308 B1), Autyetal. (U.S. patent 5,809,161), 
and Krause et al. (EP 740280 A2). Examiner refers to the rejection below. 



all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



A.) Claims 1, 4, 8, 11, 12, and 15-25 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Courtney (U.S. patent 5,969,755) and Gran et al. 



Claim Rejections - 35 USC § 103 



4. 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 



(U.S. patent 5,416,711). 
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Regarding claims 1 and 16: Courtney discloses a method for performing 
motion analysis on a sequence of images (Courtney; figs. 2-4 and col. 3 lines 1- 
2), where said sequence of images captures a plurality of objects each moving 
along a trajectory in an imaged area (Courtney; figs. 9-12, col. 3 lines 1-8, and 
col. 7 lines 47-51), said method comprising: 

extracting motion information for each of said plurality of objects contained 
in said sequence of images (Courtney; col. 4 lines 29-31 and 54-61, wherein the 
information is segmented from the images in order to obtain the stationary and 
moving objects), and 

determining spatial patterns from said extracted motion information 
(Courtney; col. 4 lines 54-61, wherein the paths of the objects are determined 
from the segmented/extracted information. These paths are read as spatial 
patterns and as the routes of the objects), where said 

determining step comprises determining a route comprising a trajectory of 
a first object having the same trajectory of at least one other object. 

Courtney discloses to obtain moving and stationary objects within a 
video/sequence of images by determining the paths/routes/trajectories of the 
objects. Courtney does not disclose to obtain determining the "route comprising a 
trajectory of a first object having the same trajectory of at least one other object." 
Gran et al. teaches to determine the route of a first object having the same 
trajectory of at least one other object (Gran et al.; col. 2 lines 59-68 and col. 8 
lines 24-34, wherein a traffic corridor, read as a "trajectory" of the traffic, is 
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monitored to observe the length of the traffic queue and/or the number of 
vehicles in the traffic queue. Determining the number of vehicles within the traffic 
queue/corridor is read as determining of "a trajectory of a first object having the 
same trajectory of at least one other object," since more than one object is 
determined in the same traffic corridor "trajectory."). It would have been obvious 
to one skilled in the art to combine the teaching of Gran et al. to that of Courtney 
because they are analogous in monitoring moving objects/traffic patterns 
(Courtney; col. 11 lines 1-4 and Gran et al.; col. 1 lines 7-10). One in the art 
' would have been motivated to incorporate the teaching of Gran et al. to the 
system of Courtney in order to provide an efficient and safe utilization of the 
nation's roads and highway systems (Gran et al.; col. 1 lines 26-28). 

Regarding claims 4, 20, and 24: The method of claim 1 wherein said 
determining of spatial patterns comprises: 

determining a source point and a destination point from said trajectory of 
said plurality of objects (Courtney; col. 4 lines 62-67, wherein the entrance and 
exit points of the moving and stationary objects are determined, which are read 
as source and destination points, respectively). 

Regarding claim 8: The method further comprising: 

determining spatio-temporal patterns from said determined spatial 
patterns along a time dimension (Courtney; col. 4 lines 7-1 1 , wherein the events 
are spatio-temporal). 
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Regarding claims 1 1 and 12: They are rejected for the combination of 
reasons of claim 1 ,9, and 10. 

Regarding claim 15: It is rejected for the same reasons as claim 1 above 
and for the following limitation of a method for displaying motion information of 
objects contained in a sequence of images (Courtney; fig. 5 elements 1 9 and 27- 
29), the method comprising: 

performing a query on a plurality of spatial patterns stored in a database, 
where each of said plurality of spatial patterns comprises a route determined 
from a trajectory common to at least two objects moving in an imaged area 
captured in said sequence of images and displayed on a user interface 
(Courtney; fig. 5 elements 27-29 and col. 5 lines 12-20 and 43-51). 

Regarding claim 17. The system further comprising a video source for 
capturing said plurality of objects in an imaged area and transmitting video 
containing said captured plurality of objects to said motion extraction system 
(Courtney; fig. 5 elements 11,15, and 21-23, wherein a video camera obtains 
images and the images are then analyzed for motion). 

Regarding claim 18: The system further comprising: 

a database for storing said spatial patterns determined from said motion 
mining system (Courtney; fig. 5 element 15); and 

a server computer for retrieving saijd trajectory satisfying at least one 
constraint specified in a query (Courtney; fig. 5 elements 27 and 28). 
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Regarding claims 19 and 23: It is rejected for the same reasons as claim 

1. 

Regarding claims 21 and 25: The system wherein said motion mining 
system determines spatio-temporal patterns from said spatial patterns along a 
time dimension (Courtney; col. 4 lines 7-1 1 , wherein the events are spatio- 
temporal). 

Regarding claim 22: It is rejected for the same reasons as claim 1 and for 
the following limitations of: 

a memory for storing a motion mining program (Courtney; fig. 5 element 

15); 

an interface (Courtney; fig. 5 elements 27 and 28); 
a processor (Courtney; fig. 5 elements 27 and 28). 

B.) Claim 3 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Courtney (U.S. patent 5,969,755), as modified by Gran et al. (U.S. patent 
5,416,71 1 ), and further in view of Koike (U.S. patent 6,445,308 B1 ). 

Regarding claim 3: Courtney discloses to obtain moving and stationary 
objects within a video/sequence of images by determining the 
paths/routes/trajectories of the objects. Courtney, as modified by Gran et al., 
teaches to obtain a number of objects within the same trajectory. Neither 
Courtney nor Gran et al. teach to "determining whether said trajectory of a 
second object is within a threshold distance said trajectory of said first object 
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and including, if said trajectory of said second object is within the threshold 
distance, said trajectory of said second object in said route." Koike teaches this 
limitation wherein the trajectory of the first object is determined to be within a 
threshold value of the trajectory of a second object (Koike; fig. 20 and col. 17 lines 
36-44 and 54-59, wherein a threshold is used to determine the possibility of a 
collision based on the objects trajectories, i.e. two moving object trajectories 
coming within a certain distance/threshold). It would have been obvious to one 
skilled in the art to combine the teaching of Koike to the disclosure of Courtney, 
as modified by Gran et al., because they are analogous in determine object 
motion path using trajectories. One in the art would have been motivated to 
incorporate the teaching of Koike to the system of Courtney, as modified by Gran 
et al., "to avert a collision with another vehicle by obtaining accurate motion 
information" (Koike; col. 1 lines 63-64). 

C.) Claims 5, 6, 9, 10, 13, and Hare rejected under 35 U.S.C. 103(a) as 
being unpatentable over Courtney (U.S. patent 5,969,755), as modified by Gran 
et al. (U.S. patent 5,416,711), and further in view of Krause et al. (EP 740280 
A2). 

Regarding claims 5, 6, and 13: Courtney discloses a system to determine 
multiple objects in motion within a video. Courtney further discloses to determine 
the objects entry and exit points (Courtney; col. 4 lines 62-67, wherein the entry 
and exit points are read as the source and destination points, respectively). 
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Courtney, as modified by Gran et al., does not teach "determining whether a 
number of trajectories originating from a location is greater than a threshold 
number and identifying, if the number of trajectories originating from the location 
Is greater than the threshold number, the location as said source point" nor do 
they teach "determining whether a number of trajectories ending at a location is 
greater than a threshold number and identifying, if the number of trajectories 
ending at the location is greater than the threshold number, the location as said 
destination point." Krause et al. teaches to look at the number of cars coming into 
a sector/region and the number of cars at the end of the sector to determine 
against a threshold value if there is a hold up in that traffic sector (Krause et al.; 
English translated version of the abstract which has been provided). It would 
have been obvious to one skilled in the art to combine the teaching of Krause et 
al. to that of Courtney, as modified by Gran et al., because they are analogous in 
traffic monitoring. One in the art would have been motivated to incorporate the 
teaching of Krause et al., modified to threshold the trajectories for their number of 
entrance points and their exit points and label them accordingly, to the system of 
Courtney, as modified by Gran et al., in order to determine the traffic level and 
speed (Krause et al.; abstract). 

Regarding claims 9 and 10: Courtney discloses a system wherein the 
motion of objects in a video are determined. Courtney further discloses to obtain 
the events as spatio-temporal information wherein the movements will be 
recorded according to the time that the event(s) happened (Courtney; col. 4 lines 
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54-67 and col. 5 lines 1-17). Courtney does not teach the feature of "determining 
a busy time for said route, where the busy time represents a time when a number 
of trajectories for said plurality of objects along said route is greater than a 
threshold number" nor teaches "determining a periodicity of at least one 
trajectory in a route." Krause et al. teaches to obtain the number of vehicles in a 
sector based in a sector of traffic to see if there is a traffic hold up (Krause et al.; 
abstract). It would have been obvious to one skilled in the art based on 
Courtney's disclosure and the teaching of Krause to modify the system wherein 
the events of object motion/trajectories can be determined to see when it is/are 
the busiest time(s), how often it is happening/periodicity/frequency, how many 
objects involved, etc. 

Regarding claim 14: It is rejected for the same combination of reasons of 
claim 1 with claims 9 and 10. 

D.) Claim 7 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Courtney (U.S. patent 5,969,755), as modified by Gran et al. (U.S. patent 
5,416,711), and further in view of Autyetal. (U.S. patent 5,809,161). 

Regarding claim 7: Courtney discloses a system to determine multiple 
objects in motion within a video. Courtney further discloses to determine the 
objects entry and exit points (Courtney; col. 4 lines 62-67, wherein the entry and 
exit points are read as the source and destination points, respectively). Courtney, 
as modified by Gran et al., does not teach "wherein said source point and said 
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destination point are determined using a clustering process". Auty et al. teaches 
to use cluster processing to obtain and classify certain points in an images of 
moving objects (Auty et al.; col. 12 lines 65-67 and col. 20 lines 20-35). It would 
have been obvious to one skilled in the art to combine the teaching of Auty et al., 
modified to determine the source and destination points using clustering, to the 
system Courtney, as modified by Gran et al., for tracking moving objects over a 
multi-lane carriageway (Auty et al.; col. 2 lines 53-55). 



Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Nasburg (U.S. patent 5,801 ,943) for a traffic surveillance system. 
Minovitch (U.S. patent 4,361 ,202) for a automated road transporatation 
system. 

Contact Information 

6. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Anand Bhatnagar whose telephone number is 
(703) 306-5914, whose supervisor is Amelia Au whose number is 703-308-6604, 
group fax is 703-872-9306, and Tech center 2600 customer service office 
number is 703-306-0377. 
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